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We consider the problem of finding the optimal time to sell a 
stock, subject to a hxed sales cost and an exponential discounting 
rate p. We assume that the price of the stock fluctuates according to 
the equation dYt = Yt{pdt + a^{t) dt), where (C(t)) is an alternating 
Markov renewal process with values in {±1}, with an exponential 
renewal time. We determine the critical value of p under which the 
value function is finite. We examine the validity of the “principle of 
smooth £t” and use this to give a complete and essentially explicit 
solution to the problem, which exhibits a surprisingly rich structure. 

The corresponding result when the stock price evolves according to 
the Black and Scholes model is obtained as a limit case. 


1. Introduction. There are many examples of optimal stopping and op¬ 
timal control problems in continuous time that involve diffusion processes 
and that have an explicit solution (see, e.g., [1, 16, 21, 22]), but it is rare 
that the discrete form of the problem, in which the diffusion is replaced by 
a random walk, can also be solved explicitly (an exception is [2]; see also 
[3], Chapter 10). One reason is that in the continuous case, it is possible to 
use the so-called principle of smooth fit, first studied in detail in [9]; see also 
[23], [14], Chapters 1 and 6, and [5], as well as [22], page 636, for a discussion 
of this principle and its history. In the discrete case, the problem is much 
more combinatorial and no such principle is available. 

In this paper, we consider a particular optimal stopping problem in an 
intermediate situation, in which time is continuous but the driving noise is 
discrete. We show that the principle of smooth fit holds in some situations 
but not in others, and that the difference between the situations sheds some 
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light on why this principle should hold in the hrst place. It turns out that 
this semidiscrete problem admits an essentially explicit solution. 

The specihc problem we consider is when to sell a stock, subject to a 
hxed sale cost a and an exponential discounting at rate p. In the classical 
Black and Scholes model, the stock price is a solution of the stochastic 
differential equation 

(1.1) dYt = Yt{pdt + adBt), Yo = y, 

where (Bt) is a standard Brownian motion, and p and a are constants. The 
problem is to hnd a stopping time r which maximizes the expected reward 
E{e~P^(Yr — a)). This continuous-time problem can be elegantly solved ex¬ 
plicitly (see [18], which was the starting point for this paper). 

Here, we consider a semidiscretized form of this problem: The driving 
noise dBt is replaced by an alternating renewal process > 0) with 

values in {±1}, with an exponential renewal time with mean 1/A. Equa¬ 
tion (1.1) is replaced by 

dYt = Yt{pdt +a^{t)dt), Yo = y, 

which is a (random) ordinary differential equation. The problem is again to 
hnd a stopping time r which maximizes the expected reward E{e~^ {Yt — 
a)), and even to hnd the value function g{t, y, s), which represents the maxi¬ 
mal expected reward if we are at time t, the current stock price is y, ^(t) = s 
and we proceed optimally from time t on. 

The Markovian noise process ^(t) dt is sometimes called telegrapher’s noi¬ 
se [11] and the process (Yt) is known as a piecewise deterministic Markov 
process [4] or a random evolution process [20]. This semidiscrete problem 
is in a sense “simpler” than the previous one, since it does not appeal to 
Brownian motion and stochastic differential equations, so the statement of 
the problem is elementary. The process ^(t) can be thought of as an up 
or down trend, which may be appropriate on certain time scales and in 
certain applications. Furthermore, there is a nontrivial covariance between 
f{t) and ^{t h), namely which is not the case for white noise dBt. 

Finally, taking an appropriate limit as A t +oo and a t -koo, we should re¬ 
cover the solution from the Black and Scholes model [although (1.1) will 
have to be interpreted in the Stratonovitch sense; see Remark 12]. 

It turns out that the structure of the solution to our problem depends 
heavily on the relationships between the four parameters p, p, a and A. If p 
is too small, then it is never optimal to stop and sup^ E{e~^{YT — a)) = -|-oo. 
Therefore, the problem is of interest only for sufficiently large values of p‘. 
The critical value is determined in Theorem 1. 

It is well known [7] that the optimal stopping rule can be described via 
a “continuation region” and a “stopping region,” and for continuous-time 
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problems, the principle of smooth fit states that the value function g should 
be smooth at the boundary between these two regions. Here, we can es¬ 
tablish that the principle of smooth fit does indeed hold at certain such 
boundary points (see Proposition 7), but not necessarily at others. There¬ 
fore, the principle of smooth fit at these points yields necessary conditions 
on the value function, rather than guesses that need to be confirmed, as is 
generally the case. 

In developing our solution, we essentially had two choices. The first was to 
“guess” the solution, and then establish that the proposed solution is correct. 
This is the approach used, for instance, in [16] and [22]. The second choice 
was to use the general theory of optimal stopping, as developed in [7], to 
establish existence and basic properties of optimal stopping times. While the 
first approach is more elementary, it requires heavy algebraic calculations. 
Therefore, we preferred the second approach: The knowledge that an optimal 
stopping time exists can be used advantageously to derive conditions that are 
necessarily satisfied by the value function and this simplifies the calculations 
(even though they remain intricate). 

In the solution to our problem, the possible sign of p — g — a plays an 
important role. Intuitively, there are two competing features in the problem: 
the discounting tends to decrease the effect of the hxed sale cost a, which 
encourages waiting and selling later, versus the discounting of the sale price, 
which encourages selling immediately. For large values of the sale price, the 
hxed cost a becomes negligible. When p < p + a, during an up trend, the 
stock price increases at a faster rate than p, so no matter what the stock 
price, it is always optimal not to stop as long as the trend is up. On the other 
hand, when p> p + a, the discounting is stronger than the increase in stock 
price, even during an up trend, so for large stock prices, the continuation 
effect from the hxed sale cost loses out and it becomes optimal to stop, even 
during an up trend. These observations are conhrmed by our analysis. 

It turns out that when p — p — a is negative, we obtain an explicit solution 
given by algebraic formulas (Theorem 10 for the case where p — a <0 and 
Theorem 14 when p — a > 0). When p — p — a > 0, the solution is essentially 
explicit, up to solving one transcendental equation (see Theorem 13 for the 
case where p — a <0 and Theorem 16 if p — a > 0). Finally, in Remark 12, 
we show how to recover the solution to the problem where the stock price 
is given by (1.1) as the limit, when A t oo, cr j oo and cr/\/A ^ aQ, of the 
solution to our semidiscrete problem. 

2. Stating the problem. Consider a two-state continuous-time Markov 
chain (^(t), t>0) with state space S = {—1,-|-1}, defined on a complete 
probability space Processes such as this are discussed in most 

textbooks on stochastic processes [10, 20]. We assume that the infinitesimal 
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parameters of this Markov chain are given by the matrix 

(2.1) G=(-" 


where A > 0. For r,s £ S, let Pr,s{t) = = ■s|^(0) = r) and set P{t) = 

{pr,s{t))- Then 



1 + e 

1 - 


1 — e A 

1 + ) ■ 


Fix positive real numbers p and a, let 


V (s) = p + sa 


and consider the process {Yt,t > 0), which is a solution of the equation 

(2.2) -^ = V{m)Yu t>0. 

Equivalently, 

(2.3) Yt = YQexp^pt + a J ^{u)du 

Let {Pti t>0) be the natural filtration of Clearly, (JP)) is also 

the natural filtration of (Yt). We complete this filtration and then it is also 
right-continuous. The process (Y)) is not a Markov process with respect to 
this filtration, whereas the couple {Yt,^{t)) is a Markov process with state 
space M+ x S. We let Py^^so denote the conditional probability given that 
Yq = uq and ^(0) = sqj and let EyQ,sa denote expectation under Py^^sQ- 

As mentioned in the Introduction, we assume that Yt denotes the price 
of an asset at time t and we wish to sell this asset at the highest possible 
price, subject to a fixed transaction cost a > 0 and a discounting rate p > 0. 
That is, the benefit of a sale at time t is given by the reward process (At) 
defined by 

(2.4) Xt = e-P\Yt-a). 


Problem A. Find a stopping time t° relative to the filtration (At) such 
that 

(2.5) EyQ^so{XT-o) = supEyQ^sQ(AT-), 

r 

where the supremum is over all (At)-stopping times. 
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3. Conditions under which the value function is finite. The value func¬ 
tion for Problem A is 

g{yO, So) = sup Ey^^soi^r)- 

T 

Of course, Problem A is only interesting if this function is finite. The first 
theorem identifies the conditions on the parameters of the problem that 
ensure that this is indeed the case. 


Theorem 1. Given yo>0 and sq £ S, g{yo,so) < oo if 
(3.1) p > // — A + + A^. 

In fact, condition (3.1) holds if and only i/£'j^p^so(suPt>o l^d) < oo, while 
p < p — A + + A^ if and only if supj>o Eyg^sg{Xt) = +oo. 


Proof. According to [8], Section III. 4, the infinitesimal generator of 
{Zt), where Zt = (Y),^(t)), is the operator A, defined for /;K+ x 
such that f{-,s) is continuously differentiable for each s £ S', by 

Z^-fiy, s) = V{s)y^{y, s) + Gf{y, s), 

where Gf{y,s) = G* _i/(y,-1) + Gs,+i/(y,+1) and the Gs,r are the in¬ 
finitesimal parameters of (^(t)) from (2.1). 

It is not difficult to check that the law of Y) under Py^^sa is absolutely con¬ 
tinuous, with compact support, and we let p{yo, so;t,y, s) denote its density 
on {f{t) = s}, that is, for all Borel sets A, 

Pyo,so{^t ^ = ■^} = / P{yo,so]t,y,s)dy. 

J A. 

We use this to give a formula for Ey^^soiXt)- Although we could appeal 
to [13], we prefer, for convenience of the reader, to give the derivation. The 
Kolmogorov forward equation ([12], Chapter 5.1, page 282) states that for 
(yO) So) £ M+ X S fixed and all t > 0, (p, s) £ M+ x S, 

dp d 

(3.2) —{yo,so-,t,y,s) = - — {V{s)yp{yo,so-,t,y,s)) + Gp{yo,so-,t,y,s). 

Set 

poo 

f{yo,so-,t,s) = Eyg^soXA{^{t)=s}) = J^ yp{yo,so]t,y,s)dy. 

Multiply both sides of (3.2) by y, then integrate over [0,oo[ with respect to 
y to find, after an integration by parts and because y ^ p{yo, so]t,y, s) has 
compact support, that 

df 

-^(po, so; t,s) = V (s)/(po, so; t, s) -L G/(po, so; t, s). 
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Substitute s = ±1 and suppress (yo,so) from the notation to get 
-1) = (m- cr)f{t, -1) - Xf{t, -1) + Xf{t, +1), 

■^(t, +!) = (// + a)f{t, +1) + Xf{t, —1) — Xf{t, +1). 

This is a linear system of two differential equations in the unknowns t e-> 
/(t, ±1), governed by a matrix with constant coefficients. The eigenvalues 
of this matrix are 

Ki = // — A + and K 2 = — X— \/cr^ + A^. 

Therefore, 

^yo,so0^t) = /(yo,so;i,-l) + /(yo,'So;i,+l) ~exp(«:it) ast^oo 

and 

~ exp((Ki - p)t) ast^oo. 

If p < p — X + \/(j2 + A^, then ki — p > 0, so supi>g Ey^^soi^t) = +oo if and 
only if this inequality holds. 

Suppose now that (3.1) holds. To show that i?yp^s(,(supj>o < oo, it 
clearly suffices to show that iiij;(,^s(,(supj>o M^) < oo, where Mt = e~P^Yt. We 
distinguish two cases. 

Case 1. If p> p + a, then dMt = {p — p + cr^{t))Mt < 0, so the sam¬ 
ple paths of (Mt) are nonincreasing and suptMt < yo, Py^^sQ-s^-S- Therefore, 
^j/o,so(suPt>o Mt) <yo<oo. 

Case 2. If p < p + u, then we proceed as follows [note first that p — 
X + Va^~+~M < p + a, so the condition p < p + a is compatible with (3.1)]. 
The infinitesimal generator A of the Markov process Zt = (Mt,^(t)), which 
applies to functions /: M+ x 5 —> R, is given by 

^f{y, s) = ip- p + sa)y^{y, s) + Gf{y, s). 

dy 

Therefore, the process {f{MtA{t)),t > 0) is a martingale if 

d f 

(3.3) {p-p + sa)y^{y,s) + Gf{y,s) = 0, {y,s)eR+xS. 

dy 

Let h{z,s) = /(e^,s), so that h{-,-) satishes the linear equation 
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Substitute s = ±1 into this equation to get 

^ ^ / \/{ii-p-a) p-a)\ (h{z,-l)\ 

dz\h{z,+l)) \-\/{p-p + a) \/{p-p + a)) \h{z,+l)) ' 

This is a linear system of two differential equations in the unknowns z ^ 
h{z, ±1), governed by a matrix with constant coefficients, whose eigenvalues 
are 0 and fl, where 

Q = 2X{p - p)[a‘^ -{p- pf]~^- 


Note that because p> phy (3.1) and since we are in Case 2, it follows that 
> 0. The corresponding eigenvectors are 


1 

1 


and 


/-{p-p) + a\ 
\ p-p+a ) 


Therefore, there are constants Ci and C 2 such that 


h{z, s) = Cl + C 2 {s{p - p) + 


and so 

f{y, s) = Ci + C2{s{p - p) + (j)y^. 

Let us choose Ci = 0 and C 2 = 1. Given Q < a <y <h < 00 , define T = inf{t > 0: Mt ^ [a, b]}. 
The process (/(MiaTjA T), t > 0) is a bounded martingale. By (3.1), 
p> p, so by (2.3) and the law of large numbers, 

(3.4) lim Mt = 0, Py^<j-a.s. 


and therefore T < 00 Py^g-a.s. By the optional stopping theorem ([6], Chap¬ 
ter 4.7, (7.4)), we see that 

fiy,s) = EyMiMT,aT))]- 

As p — p — a < 0 and p — p + cr > 0, Mt cannot reach b for the first time when 
= — 1 , or a for the first time when ^{t) = -|- 1 , so ^(T) = -|-1 when T = b 
and ^{T) = — 1 when T = a. Let Tx = inf{t > 0 : Mt = x}. It follows that 

f{y, s) = f{a,-l)Py,s{Ta < n} + f{b, +l)Py,s{Tb < Ta}, 


which implies that 


Py,s{Tb < Ta} 


Let a I 0 to find that 


f{y,s) - 

f{b,+l)-f{a,-l)' 


Py.\ sup Ml > b 


PyA'^b < 00 } 


f{y,s) ^ fiy,s) 
f{b,+l) p-p + a 


and, therefore, EyA^'^Vt ^t) < 00 if and only if 12 > 1, that is, 2\{p — p)> 
a'^ — {p — pY, which is equivalent to inequality (3.1) [to see this, isolate 
the square root in (3.1), square both sides of the inequality and simplify]. 
Theorem 1 is proved. □ 
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4. Existence of an optimal stopping time. In view of Theorem 1, we 
restrict our study to the situation where condition (3.1) holds, that is, for 
the remainder of the paper, we make the following assumption. 

Assumption A. The parameters of the problem satisfy 

p ^ — At t a^. 

To apply results from the general theory of optimal stopping in continuous 
time, we set X+oo = 0. 

Theorem 2. Under Assumption A, there exists an optimal stopping 
time T° , in other words, t° satisfies (2.5). 

Proof. We apply Theorem 2.41 of [7]. Notice first that 1 1 —> is con¬ 
tinuous from [ 0 , 00 ] to M. Indeed, the only issue is continuity at Too, which 
follows from (3.4) A p < p + a and from (2.4) and (2.3) if p> p + a, since in 
this last case, 

0 < e~^^Yt < Toexp((—p + p + a)t) for all t > 0. 

Furthermore, (Xt) is bounded below by —a, adapted and “of class D” [i.e., 
the family (Xj- , r a stopping time) is uniformly integrable] by Assumption A 
and Theorem 1. Therefore, the hypotheses of [7], Theoreme 2.41, are satished 
and the existence of an optimal stopping time is established. □ 

5. First properties of the value function. From the general theory of 
optimal stopping in continuous time [7], we know that the solution to Prob¬ 
lem A uses SnelVs envelope of the reward process {Xt,t > 0), that is, a 
supermartingale {Zt,t > 0) such that for all (y, s), Py,s-a.s, 

Zt = esssupEy^s{Xr\Xt), 

where the essential supremum is over all stopping times t >t. Because the 
reward process has the special form Xt = e“^*/o(Ft,^(t)), where 

(5.1) fo{y, s) = fo{y) = y-a (no dependence on s), 

it follows from [7], Theoreme 2.75, that in fact, 

Zt = e-f>^g{Yt,m), 

where g{y, s) is the value function, and there is an optimal stopping time of 
the form r° = inf{t > 0: g{Yt,^{t)) = fo{Yt)} ([7], Theoreme 2.76). We there¬ 
fore examine properties of the function g{y,s) and of {y:g{y,s) = y — o}. 
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Proposition 3. (a) Fors€S, y^g{y,s) is convex (therefore contin¬ 

uous) and nondecreasing. Furthermore, g{y,s) > max(/o(y),0). 

(b) For s G S, the set {y G M+ :g{y,s) = y — a} is an interval [its,+oo[ 
(which may he empty, or, in other words, Us = +oo may occur). 

Proof, (a) We note from (2.3) that the law of Yt under Py^g is the same 
as the law of yYt under and, therefore, 

g{y,s) = supEi^s{e~P'^{yYr - a)). 

T 

For a given stopping time r and s G S, 

(5.2) y ^ Ei4e-P^yYr - a)) = y£;i,,(e-^"W) - aPi,.(e-^") 

is a nondecreasing and affine function of y. Therefore, y g{y,s), as the 
supremum of such functions, is nondecreasing and convex. 

Observe that for any t > 0, 

g{y, s) > Ey^g{Xt) = Ey^g{e-P^Yt - e-P^a) > -e-P^a. 

Let t —> +00 to see that g{y, s) > 0. It is also clear that g{y, s) > Ey^s(^o) = 
fo{y), so we conclude that g{y,s) > max(/o(y),0). 

(b) Let cSs = {y G R+:g'(y,s) = y-a}, sG{- 1,+1}. Then for any yo S 5* 
and any stopping time r. 


Eps{e P'^fo{yoYr))<g{yo,s) = yo-a. 

Using (5.1), this is equivalent to 

yo{Epgie-P^Yr) - 1) + a(l - Pi,.(e-^")) < 0. 

The second term is nonnegative, so this inequality implies that Ei^s{e~P'^YT-) — 
1 < 0 and, therefore, it remains satisfied for any y >yo: 

y(Pi,,(e-^"W) - 1) + a(l - Pi,.(e-^0) < 0- 

However, this inequality translates back to 

Ei,s{e~P^foiyYr)) <y-a. 

Take the supremum over stopping times r to conclude that g{y, s) <y — a 
and so y G Sg. 

We conclude that if yo G Sg and y>yo, then y G Sg, which shows that 
either Sg = 0 or Sg is a semiinfinite interval, as claimed. □ 
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6. The value function in the continuation region. For s € S, let Ug be 

defined as in Proposition 3. We write u± instead of u±i. By Proposition 3(b) 
and [7], Theoremes 2.18 and 2.45, it is optimal not to stop when {Yt,^{t)) 
belongs to the continuation region 

C = ([0,u_[x{-l})U([0,n+[x{+l}), 

while the smallest optimal stopping time is r° = inf{t > 0: (Y), ^(t)) € (M_|_ x 
5)\C}. Set 

g{t,y,s) = e~P^g{y,s). 

Then the process {g{t,Yt,^{t)),t > 0) is a supermartingale, while {g{t A 
/\T°)),t > 0) is a martingale ([7], Theoreme 2.75 and (2.12.2)). 
This has the following consequence. 

Proposition 4. (a) The relationship u- < holds. 

(b) The set {y G M+ ■ din, — 1 ) = U — a} is nonempty or, in other words, 

U- < + 00 . 

Proof, (a) We distinguish two cases, according as ^ — <7 < 0 or not. 

Case 1. p, — a <0. We show that, in fact, g{-,—l) < 5 (-,+l), which 
clearly implies tt_ < rt+. Let ri be the first jump time of {^{t)). Then for 
any stopping time r, 

Ep.iie-P^MyY^)) 

= F;i,_i(e-^Vo(yb;)l{.<.i}+i5^i,-i(Xr|.^n)l{n<r}) 

< Ei-i{e~f’'^g{yYr, +1)1{^<^^} + , +l)l{ri<T})- 

Because p — a <0, te^ yYt is nonincreasing on [0 ,ti] Pi^_i-a.s. so this is no 
greater than 

-E'i,-i(i • g{y^ +i)1{t<ti} +1 ■ 5(2 /) +i)1{ti<t}) = 9{y^ +i)- 
Therefore, g{y, -1) < g{y, +1). 

Case 2. p — a > 0. We note that in this case, 1 1 —> 1) is monotone and 
increasing, and it suffices to consider the case where < 00 . Suppose by 
contradiction that u+ <U-. Fix y G [«+,«_[, so that g{y,+l) = y — a and, 
in particular, for any t > 0, 

^i,+i(e-^("i^*)(yy,,At-a))<y-a. 

Let t- = {p — a)~^ln{u-/y), so that > 0 and on {ti > t_}, yYt, 
Pi-i-a.s. 


= U- 
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Set cJi = Ti A Because of the form of the continuation region (given 
above), ai =r°, Py-i-a..s. and, therefore, 

( 6 . 1 ) = 

Since 


hViAt. = exp((/i ± cj)(ri A t_)) Pi,±i-a.s. 

and the law of ri is exponential with mean 1/A, both under Pi^-i and under 
we see that the right-hand side of (6.1) is bounded above by 

{yYr^M- - a)) <g{y,+l) = y-a, 

because y > u+. It follows that g{y, —1) <y — a, and by Proposition 3(a), this 
inequality must be an equality. Therefore, (y,—1) belongs to (M+ x S)\C, 
which contradicts our assumption that y <U-. This proves that U- < as 
claimed. 

(b) If u- were equal to -|-oo, then tt_|_ = -|-oo by (a), so the continuation 
region would be C = M+ x S and, therefore, t° = -|-(X) would be the smallest 
optimal stopping time by [7], Theoreme 2.45. However, the reward associated 
with this stopping time is 0, which is clearly not optimal. □ 

The supermartingale and martingale properties mentioned just before 
Proposition 4 translate into 

(6.2) *4y(t, y, s) < 0 for all (t, y, s) G M+ x M_|_ x S 
and 

(6.3) Ag{t,y,s) = 0 for (t,y,s) G [0,r°[ xC, 

where A is the infinitesimal generator of Zt = (t, By [8], Section III.4, 

y, s) = e~P^ [-pg{y, s) + v{s)y^{y, s) + Gg{y, s)^, 
so 

da 

(6.4) -py(y,s)-LH(s)y^(y,s)-LGy(y,s) = 0, (y,s)GC. 

A priori, this equality is only satisfied a.e., but since y i—> g{y,s) is convex, 
hence continuous, the fact that (6.4) is satisfied a.e. implies that it is, in fact, 
satished everywhere in C [let yn^V with (6.4) satished at each {yn,s) G C 
and take y^ monotone increasing, then decreasing, to conclude that both 
the left and right derivative of g{-,s) agree at (y,s)]. 

Equality (6.4) provides us with a specific form for g\c. 
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(6.5) 

and 

( 6 . 6 ) 


Proposition 5. (a) Define 

(A + p)ii ± \/+ cr'^ip^ + 2Xp) 


r2-i- = 


/i2-a2 


1, P 


There are eonstants C- and (7+ such that for 0 < y < tt_, 

(6.7) g{y,-l) =C-W-y^- +C+w+y^+, 

(6.8) g{y,+l)=C.y^-+C+y^+. 

(b) Let 

(6.9) b = X{X + p — p — a)~^ and Ll = {X + p){p + a')~^. 
There is a eonstant C sueh that, for U- < y < u+, 


( 6 . 10 ) 


9{y, +1) = by- + ^y^- 

X + p 


Proof, (a) Equation (6.4), written for (y,s) G [0,u_[x5, gives 
da 

(6.11) y{p - cr)^{y, -1) - (A + p)g{y, -1) + Xg{y, +1) = 0, 

dy 

da 

(6.12) y{p + 0-) Y^(y, +1) + Xg{y, -1) - (A + p)g{y, +1) = 0. 

dy 

The same change of variables that was used to solve (3.3) transforms these 
two equations into a linear system of differential equations governed by a 
matrix with constant coefficients, whose characteristic polynomial is {pfi — 
(7^)“^ multiplied by 

(6.13) p{w) = {p^ — — 2p{X + p)w + {p^ + 2pX). 

The roots of this polynomial are easily seen to be Ll- and 11+ given in (6.5), 
and the associated eigenvectors are 

f w+' 


u;_ 

1 


and 


V 1 


where u:± are given in (6.6). This leads to the formulas in (6.7) and (6.8). 
(b) Equation (6.4), written for y G [u-,u+] and s = +1, yields the equation 

da 

(6.14) y{p + +1) - (A + p)g{y, +1) + X{y - a) = 0, 

because g{y, — 1) = y — a for these y. The solution of this first-order linear 
differential equation is easily seen to be given by (6.10). □ 
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Remark 6. (a) By isolating the square root in (3.1) and squaring, we 

see that Assumption A is equivalent to the condition p{l) > 0, where p{-) is 
the polynomial in (6.13). 

(b) Assumption A clearly implies X + p — p — a > 0 and, therefore, R > 1. 


7. The principle of smooth fit. Proposition 5 gives the form of the value 
function in the continuation region, but the numbers of u±, C± and C remain 
to be determined. In many control problems for diffusions [1, 9, 21, 22], 
this is done using the principle of smooth fit. In the presence of piecewise 
deterministic processes, it is not a priori clear whether this principle applies, 
and we will see that this need not be the case. In this problem, the principle 
of smooth fit states that 


as dfo/dy = 1. 


lim ^(y,±l) = 1 
y^u± oy 


Proposition 7. (a) If p — a > 0, then the principle of smooth fit is 

satisfied by at tt_. 

(b) //n+ < + 00 , then the principle of smooth fit is satisfied by ( 7 (-,+l) at 
u+. 


Proof, (a) We let y^u- in (6.11). Because ( 7 (-,±l) is continuous and 
g{u-, — 1) = /o(tt-), we hnd that 

da 

(7.1) u-{p-a) lim -^{y,-1) - {X + p)fo{u-) + Xg{u-,+l) = 0. 

y]u- dy 

For y > M_, Ag{t,y,-1) < 0 and g{t,y,-1) = e-P^fo{y), so 

y{t^- - {^ + p)foiy) + Xg{y,+1) <0. 

dy 

Because {dfo/dy){y) = 1, we let y J, tt_ to find that 

u-{p-cr) - {X + p)fo{u-) + Xg{u-,+l) < 0. 


Since we have assumed that p — a > 0, together with (7.1), this implies 

(7.2) lim ^(y,-l) > 1. 

y]u- ay 

By Proposition 3(a), y(-,—1) is convex; therefore, y i—> ||(y, —1) is nonde¬ 
creasing. As y(y, —1) = /o(y) for y > m_ and {dfo/dy){y) = 1, we conclude 
that the inequality (7.2) is in fact an equality and (a) is proved. 
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(b) We let y t in (6.14) to see, similar to the above, that 

(7.3) u+{^i + a) lim ^(y,+l) - (A + p)/o(n+) + A/o(m+) = 0. 

y^u+ ay 


For y>u+, use the inequality Ag{t, y, +1) < 0 to get 

yifJ- + cr)^{y) - (A + p)/o(y) + A/o(y) < 0. 
dy 

Since {dfo/dy){y) = 1, we let y | to find that 

u+{n + cr) - (A + p)fo{u+) + A/o(u+) = 0. 


Because y + cr > 0, together with (7.3), this implies 


lim ^(y>+l) > 1 

y^u+ ay 


and equality follows as in (a). □ 


Remark 8. The formulas in Theorems 10 and 13 below can be used to 
check that when y — a < 0, the principle of smooth fit is not satisfied by 
y(-,-l) at U-. 

The statements in Proposition 7 can be related to the sample path prop¬ 
erties of the process (17, ^(t)). Indeed, when y — a > 0, 1 1 —> 1) is nondecreas¬ 
ing, so the process ( 17 ,^(t)) can enter the stopping region [rt_,-|-oo[ x{—1} 
through the boundary point (rt_, —1): The principle of smooth fit is satisfied 
at {u-, —1) in this case. When // — cr < 0, then is decreasing on the 

event {^{t) = —1}, so the only way to enter the region [u_,-|-oo[ x{—1} is 
if Yt > U- and ^{t) changes from -|-1 to —1: In this case, (lt,^(t)) has not 
encountered the boundary point (u_,—1) and the principle of smooth fit 
is not satisfied there. The same considerations apply at (u+,-t-l): The only 
way for the process {YtA{t)) to enter the stopping region -|-oo[ x{-|-l} is 
through the boundary point (u+,-|-l), and the principle of smooth fit holds 
at this point. 

These observations parallel those in [19], page 304, which Shiryaev pointed 
out to us shortly before the completion of this paper. A nice feature in the 
proof of Proposition 7 is that the validity of the principle of smooth fit at 
the boundary points of the stopping region is a fairly direct consequence of 
the basic relationships (6.2) and (6.3). 


8. Explicit computation of the value function. We distinguish four cases, 
presented below as Theorems 10, 13, 14 and 16, according to the possible 
relationships between the various parameters. Let u± be as in Proposition 3 
and let 


^±,w±,i},b:C± and C 
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be as defined in Proposition 5. Only the five numbers u±, C± and C re¬ 
main to be determined, since the other six numbers are given explicitly in 
Proposition 5. We begin with the following relationships. 

Lemma 9. (a) The growth of the function y i—> g{y,+l) as y —> oo is 
linear. 

(b) Suppose p< yL + a. Then tt_|_ = -|-oo and C = 0. 

(c) Suppose p> fi + a. Then b <1, C > 0 and u+ < oo. 

(d) Suppose p — a <0. Then < 0 < and (7+ = 0. 

(e) Suppose p — a > 0. Then 0 < n_ < and uj+ < 0 < a;_. 

Proof, (a) In the region [a_,-|-oo[ x{—1}, Ag < 0 by (6.2) or, equiva¬ 
lently, 

-p{y -a) + y{p - a) -L Xg{y, -Ll) - X{y - a) < 0. 

This inequality can be written 

9{y, +1) <-- y - 

Therefore, g{y,+l) grows at most linearly when y—> -|-oo. 

(b) Set f{t,y,s) =e-P^foiy) (no dependence on s). Observe that for large 

y, 

-4/(L y, -Ll) = e~P\-pfoiy) + {p + (T)y) 

= e~P\{-p + p + a)y + ap) 

>0, 

because we have assumed that p < p +a. Assume that < oo. Then for y > 
u+>u_, f{t, y, ±1) = g{t, y, ±1), so Af{t, y, +1) = Ag{t, y, -(-1) < 0 by (6.2). 
This contradiction shows that = -|-oo. 

On the other hand, 12 > 1 by Remark 6(b). Therefore, (6.10) and (a) imply 
that C = 0. 

(c) Note that in this case, C = 0 is not possible, because p> p +a implies 
that b in (6.9) satisfies 6 < 1, so it is not possible to have by — aX{X + p)~^ > 
y — a for all y > 0. Therefore, C > 0. Because 12 > 1 by Remark 6(b), we 
conclude from part (a) and (6.10) that < oo. 

(d) Recall that f2± are the roots of the polynomial p{-) in (6.13). When 
p — a < 0, the product of the roots is negative and 12+ < f2_ by (6.5), 
so f2+<0<f2_. Prom the fact that g{-,s) is continuous and y(0,s) = 0, 
(6.7) and (6.8) imply that (7+ = 0. 

(e) Because p — a > 0, the sum and product of the roots of p(-) in 
(6.13) are positive, and f2_ < 12+ by (6.5), so 0 < 12_ <12+. From (6.6), 
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this immediately implies that — U- <0. To get the more precise re¬ 
sult in the statement of the lemma, use (6.6) to check that < 0 < a;_ 
is equivalent to < {X + p)/[^ + a) < and this follows from the fact 
that p((A + /9)/(/i-I-cr)) =-A^ (<0), as is easily checked. □ 


Theorem 10. Under Assumption A, assume that 


p< p + cr and p — a <0. 


Then the value function gr(-,±l) (see sketch in Figure Ij, expressed by the 
formulas in Proposition 5, is characterized by (7+ = C = 0, n+ = +oo and 


( 8 . 1 ) 


C_ 


U- — a 


n_ ’ 

UJ-U_ 


U- = a 


T - {X/{X +p))uj- ' 
1 — 


Proof. By Lemma 9(b), = +oo and C = 0. By Lemma 9(d), C+ = 0. 

The two remaining unknowns, namely C- and U -, are determined by match¬ 
ing the value of g{u-, —1), as expressed in (6.7), with u- — a and matching 
g(tt_,-|-l), as expressed in (6.8), with g{u-,+l) as expressed in (6.10). This 
yields, respectively, the relationships 

C-UJ-U_ =U- — a 

and 

(8.2) C-U^~=bu-—a- -. 

X + p 

Solving the above set of equations for C- and U- gives the expressions in 
the statement of the theorem. □ 


(8.3) 


Remark 11. The number uj± can be written 
a 


ijj± = 


X{p - a) 


{X + p) ± J{X + pY + A^ — 1^ 


and this clearly implies that W- > 0, because /r — a < 0. Therefore, (8.1) im¬ 
plies U- > a and C- > 0, as expected. 


Remark 12 (The white noise limit). Fix cjo > 0 and set a = ao^/X, so 
that the process (Yt) satisfies 

(8.4) dYt = Yt{pdt + aoVXf,(t)dt), Yo = y. 

Observe that the covariance of y/Xf,{t) and ^/Xf,{t + h) is Xe~^^^, and we 
easily check that the noise source \/A^(t) converges to Gaussian white noise 
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Fig. 1. The functions g(-,±l) under the hypotheses of Theorem 10. The box indieates 
the absenee of smooth fit. 


when A ^+ 00 . In addition, the solution (Yt) of (8.4) converges weakly [24] 
to the diffusion process that satisfies 

(8.5) dZt = Ztifidt + aodWt), Zo = yo, 

where the stochastic differential equation (SDE) has to be interpreted in 
the Stratonovich sense. When the stock price is governed by this diffusion 
equation, the solution to the optimal stopping problem is well known. If we 
rewrite the SDE (8.5) as the Ito SDE 


dZt — Zt[[n + (7^12) dt + (jQ dWt) 
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then we can use the formulas from [18], Example 10.16, to get the continu¬ 
ation region [0,u] and the value function g{y)'. 


( 8 . 6 ) 


u = a 


^0 

rio — 1 ’ 


giy) = 


1 (u-a) 

y' 



[ u — a, 



- Hq 


with 


Hn — 


-g -I- y? + 2pal 


(Jn 


for y <u, 
for y>u, 


The quantities 11±(A) and a;±(A) related to (8.4) are obtained by replacing 
a in (6.5) and (6.6) with cro\/A, which gives 


Therefore, 


fl±(A) = 


(A -I- p)yL ± a/ + A(To(/0^ + 2A/?) 


p? - \al 


a;±(A) = l + ^- ^^^°^ ll±(A). 


lim n_(A) = llo and lim a;-i-(A) = 1. 

A—»'+oo A^+oo 


Furthermore, U- in (8.1) can be written in the form 


U-{X) = a 


X + p- p- ctqVX 
X + p 


11(A) 


LO-(A)-lJ 


which converges, as A —> -|-oo, to u as given in (8.6). The general theory of 
[15] and [17] predicts that limA^+oo ( 7 ( 2 /, ±1) = giy), but we can also easily 
check this from (8.1) and the formulas of Proposition 5. 


Theorem 13. Assume that 

p> p + a and p — a <0. 

(Note that Assumption A is necessarily satisfied in this case.) Then the value 
function g'(-,±l) (see the sketch in Figure 2), expressed by the formulas in 
Proposition 5, is characterized by 


(8.7) 


(7+ = 0 and C- = 


u- — a 


0J-U_ 


where U- is the smallest solution of the transcendent equation 


Cco- 
1 — buj- 


n 

u_ = a, 


U- — 
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Fig. 2. The functions g(-,±l) under the hypotheses of Theorem 13. The box (resp. arrow) 
indicates the absence (resp. presence) of smooth fit. 


b and are given in (6.9), a denotes the expression on the second right-hand 
side of (8.1), 

(8.8) C = —r and u+ = a - - -. 

^ ^ VLu^-^ p-fi-a 


Proof. By Lemma 9(d), = 0. By Lemma 9(c), < oo. The conti¬ 

nuity of g{-, —1) at U- and of 5 '(-,+l) at U- and give, respectively, 

C-UJ-U_ = U- — a, 

C-Xi^~ = bu- — a-—^-h CvP 

\ + p 


(8.9) 

( 8 . 10 ) 
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and 

( 8 . 11 ) 


bu+ — a 


A 


\ + p 


+ =u+ — a. 


By Proposition 7(b), there is a smooth fit of 5 ((-,+l) at Accordingly, 

( 8 . 12 ) b + cnu^-^ = i. 


The last equation furnishes the formula for C, which, when plugged into (8.11), 
gives after some simplification the formula for «+. 

From (8.9), we obtain directly the expression for C- given in (8.7). Plug¬ 
ging the formulas for C- and C into (8.10) yields 

(8.13) T(n_) = a>a, where T(n) = n- Cto 

1 — bu- 


with a as in the statement of the theorem. 

We check that the equation tpiu) = a has, in fact, two solutions and that 
U- is the smaller of the two. Observe that 


(8.14) 


j n / \ (7cu_n(n — 1) j-2_2 

T (u) =-^- -u 

1 — buj- 


From Remark 6(b), 17 > 1, and > 0 by (8.8) and the hypothesis p> p +a. 
Since 6 < 1 by Lemma 9(c), we observe from (8.8) that C > 0. By (8.3), 
uj- > 0. Therefore, the numerator in (8.14) is positive. A direct calculation 
using the formula for a;_ in (6.6) shows that 

1 — buj- = —6(17- — 1). 

A 

Because p{l) > 0 by Remark 6(a) and 17+ < 0 < 17_ by Lemma 9(d), it 
follows that, in fact, 17_ > 1 and, therefore, the denominator in (8.14) is 
positive. 

The above shows that T^'(m) < 0, so T is strictly concave. From (8.13) 
and the fact that 17 > 1, it follows that T(0) = 0, 'l'(tt) < u for all u > 0 and 
lim„^+oo 4'(it) = —oo. This implies that the equation 'k(tt) = a has zero, 
one or two solutions. Since tt_ is a solution, one of the last two occurs. No 
solution can be less than a, since a > a. 

To check that there are exactly two solutions of the equation T (u) = a 
and that u_ is the smaller of the two, we observe from (8.13) that 

T(u+) = u+- 


Cu^ 


{l-b)u+-a-^. 

\ + p 


(8.15) 

By (8.11), 
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Replace Cu^ in (8.15) by the right-hand side above, to find, after simplih- 
cation, that 

Therefore, > a, since this inequality is now equivalent to «+(! — u;_) > 

a{l — u>-), which holds since tt+ > a by (8.8), and uj- < 1 as we now show. 
Indeed, by (6.6), ti;_ < 1 is equivalent to p — (p-|-cj)n_ < 0, which, by (6.5), 
is in turn equivalent to 

p <-T p) ~ -|- CT^i^p^ -|- 2Ap)). 

— (J 

Multiply both sides by p — cr, changing the direction of the inequality since 
p — cr < 0, isolate the square root, then square both sides and simplify to see 
that this inequality reduces to > p?, which is satished by hypothesis. 

The inequality ^(m+) > a and the properties of T mentioned above imply 
that one of the solutions of the equation 'h (u) = o is larger than and the 
other, which is smaller than is therefore u_. □ 


Theorem 14. Under Assumption A assume that 
p < p + a and p — cr > 0. 

Then the value function p(-,±l) (see the sketch in Figure 2>), expressed by 
the formulas in Proposition 5, is characterized by C = 0, u+ = -|-oo, 

_Q_ M_(n+ - 1) - an+ 


/ X ^ _n , ri_(n_ — 1) — afl- 
(8.16) C+ = u_+ ^ ’ 


w+(n_ —11+) 


C-=u_ 


Ci;_(n_|_ — fl_) 


(8.17) u-=a 
where 

(8.18) 
and 
(8.19) 


N 

15' 


N = w+n+ — uj-Vt- ——(n_i_ — fi_) 


A -I- p 


D = (++(11+ — 1) — u;_(n_ — 1) — 


Xu]-\-UJ— 


X + p — p — a 


(fl+-fl_). 


Proof. By Lemma 9(b), u+ = -|-oo and (7 = 0. The continuity of p(-, —1) 
and p(-,-|-l) at tt_ give, respectively, 

(8.20) C-(jj-ul~ + (7+u;+u^^ = U- — a, 

( 8 . 21 ) C-U^-+C+u^+=bu_-a-^, 

X + p 
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Fig. 3. The functions gi(-,±l) under the hypotheses of Theorem 14. The arrow indicates 
the presence of smooth fit. 


where b is defined in (6.9), and smooth fit of at which occurs 

by Proposition 7(a), gives the third equation 

( 8 . 22 ) = 1 . 

Multiply (8.22) by u_, then use (8.20) and (8.22) to express C- and C-y. 
in terms of u_, which yields the formulas in (8.16). Plug these into (8.21), 
which becomes a linear equation in u- and gives (8.17)-(8.19). □ 

Remark 15. We note that u- defined in (8.17) is such that U- > a. 
Indeed, (8.17) can be written 

N X + a;+ - u;_ + ?7/(A + p) 

U- = a — = a - — -r—, 

D x + ??/(A + p-p-cj) 
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with 

X = w+(0+— 1) — a;_(r2_ — 1) and rj = Xuj^uj-{Q-— ^l+). 

We first check that D <0. This is equivalent to verifying 

X< -r//(A + /9-M-o-). 

In the definition of Xi of tj and, on the right-hand side, substitute uj± 
from (6.6) to see that this is equivalent to 

{ \ p — -\- (j )fl_) — 1) — (A-|-p — (/r-|-cj)n_)(n_ — 1) 

A^u;_u;_|_(n_|_ — fl_) 

X + p — p — a 

With a few algebraic manipulations, fl_|_ — n_, which is positive by Lemma 9(e), 
can be factored out on the right-hand side, leading to 

A-|-/3-|-/i-|-cr — (/i-|-cr)(fl+ -|- ri—) < -r-——. 

X + p — p — a 

Now plug into the right-hand side formulas (6.6) for uj± and simplify to get 

-i + n+ + n_ <n_n+. 

Use the fact that are the roots of p(-) in (6.13) to see that this is equiv¬ 
alent to 

p — /i -|- A > \/A^ -|- cj^, 

which holds by Assumption A. Hence, D <0 is established. 

We now check that < 0. By Lemma 9(e), — a;_ < 0. Therefore, the 

facts that D <0 and {X + p — p — a)~^ > (A -|- p)”^ immediately imply A" < 0. 

It follows that the inequality u_ > a is equivalent to N < D, which be¬ 
comes 

uj+-uj-< p[{X + p- p- a)~^ - (A -L p)~^] 

(notice that the factor in brackets is > 0) and, using (6.6), 

- H+) < Aw+a;_(H_ - L!+)[(A + p - p - a)-^ - (A + p)"^]. 

A 

Since — H+ < 0 and cu+cu- < 0 by Lemma 9(e), this inequality does indeed 
hold, so U- > a as claimed. 

Theorem 16. Assume that 


p> p + a and p — a > 0. 
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Fig. 4. The functions p(-,±l) under the hypotheses of Theorem 16. The arrows indicate 
the presence of smooth fit. 


(Note that Assumption A is necessarily satisfied in this case.) Then the value 
function (see the sketch in Figure 4J, expressed by the formulas in 

Proposition 5, is characterized by 


(8.23) 


^ - aTL_ _ - 1 )- 0 ^ 2 + 

+ w_(0+-0_) 


c 


l-b 


p 

= a -, 

p-ix-a 


where b and O are given in (6.9) and U- is the smallest solution of the 
transcendent equation 


(8.24) 
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with N and D defined in (8.18) and (8.19), and ‘^(u) is defined by 

(8,25) 


Proof. By Lemma 9(c), < oo. The continuity of g{-, —1) and g(-, +1) 

at U- give, respectively, 

(8.26) C-W-V^~ + =U- — a, 


(8.27) C-U^- + C+u^+ 

continuity of 5 (-,+l) at gives 


bu- — a 


A 

X + p 


+ Cu 


n 


(8.28) 


bu+ — a 


X + p 


+ Cu^ = — a 


and Proposition 7 implies two additional equations: one for the smooth fit 
of g{-, —1) at U-, 


(8.29) C-W-Q-U^- ^ + C+u;+n+u^+ ^ = 1, 


and one for the smooth fit of 5 (-,+l) at u+, 
(8.30) b + cnu^-^ = i. 


Observe that equations (8.26) and (8.29) are, respectively, identical to 
(8.20) and (8.22), which give the formulas for and C- as in (8.16). 
Equations (8.28) and (8.30) are, respectively, identical to (8.11) and (8.12), 
and this gives the formulas for C and u+ as in (8.8). Plug the formulas for 
C± and C into (8.27) to see that U- solves the equation 

^iu) = a—, 

where N and D are as in (8.18) and (8.19), and <h(u) is as in (8.25). 

We show that (8.24) has two solutions, the smaller of which is U-. Since 
6 < 1 by Lemma 9(c), we observe from (8.23) that C > 0. Since 12+ — 12- > 0 
and < 0 by Lemma 9(e), 12 < 0 as was observed in Remark 15 and 

12 > 1 by Remark 6(b), we see that <1>(0) = 0, lim,i^+oo‘^( m) = —oo and 
< 0 for all u > 0, so 4>(-) is strictly concave. Therefore, (8.24) has 
zero, one or two solutions. Since U- is a solution, one of the last two cases 
occurs. 

To show that the equation 4>(tt) = aN/D has exactly two solutions, we 
proceed as in the last part of the proof of Theorem 13: We show that ‘h(tt+) > 
aN/D, which completes the proof. 

From (8.25), 


ct;+ti;_(12+ — 12_) 



(8.31) 


^{u+)=u+ 


D 
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By (8.28), 



Replace Cv^ in (8.31) by the right-hand side above to see that 


= ^iD- uj+uj-{n+ - fi_)(i - b)) -h 

U U A + p 


Therefore, the inequality ‘h(tt_|_) > aN/D is equivalent, after using (8.18) 
and (8.19) and simplifying, to 

(8.32) (tt+ — a)(a;+n+ — — a;+a;_(n+ — H_)) + (lo- — uj+)u+ < 0. 

Use (6.6) to see that 


A 


— Ccj_n_ — (A T p — (^ T (j)(H-i_ t n_)) 


and 



so (8.32) is equivalent to 

(m+ — a)(A + p — {p + cr)(n+ + 11_) — Xojj^uj-) + {p + cr)u+ < 0. 

Plug in the formula for tt_|_ in (8.23) and use the fact that are the roots 
of p{w) in (6.13) to see that this becomes 

(8.33) (p + a)( X + p— _ Aw+u;_^ + {p + (^)p < 0- 

V p-o- J 

Using (6.6) and (6.5), we check that 

p + c 



which reduces to —2pa < 0. This proves that ‘h(tt+) > aN/D, and the prop¬ 
erties of $ mentioned above imply that one of the solutions of the equation 
<l>(rt) = aN/D is larger than and the other, which is smaller than u+, is 
therefore tt_. □ 
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